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INTRODUCTION 


This  report  describes  the  control  programs  that  have  been  developed  to 
edit,  process,  and  analyze  the  digital  data  tapes  produced  at  the  U.S.  Air 
Force  Project  OPAQUE^  Field  Station  located  in  Meppen,  Federal  Republic  of 
Germany  (abbr.  F.R.C.).  The  objective  of  Project  OPAQUE  is  to  gather  continu¬ 
ous  data  from  a  series  of  measurements  in  the  visible  and  infrared  regions  for 
a  period  of  two  years  or  more.  The  requirement  for  continuous  measurement  of 
the  experimental  parameters  has  resulted  in  the  design  of  a  microprocessor- 
controlled,  automated  field  station  that  samples  and  records  the  digital  data 
on  magnetic  tape.  The  time  span  involved  and  the  corresponding  volume  of  data 
generated  has  created  a  large  data  base  that  must  be  accessed,  processed,  and 
analyzed  by  the  experimenters. 

Early  in  the  design  cycle,  the  ULowell  Research  Team  set  forth  the  follow¬ 
ing  objectives  based  on  the  large  volume  of  data  collected  and  the  number  of 
researchers  that  would  require  access  to  that  data: 

1.  All  programs  should  be  developed  for  both  interactive  and  batch  modes 
of  processing.  This  is  to  allow  access  and  processing  from  the  ULowell 
remote  location  or  from  any  terminal  connected  to  the  Cyber  74/74  Svstem 
Computer  at  A.F.C.L. 

2.  The  user  should  have  a  reasonable  measure  of  control  over  output  formats 
search,  and  edit  procedures. 

3.  Along  with  the  customary  features  of  tabulating  or  plotting  data  points, 
some  additional  methods  of  presentation  should  be  provided  to  allow 
visual  interpretation  of  long-term  performance.  This  capability  is 
deemed  useful  in  all  phases  of  processing  and  in  the  determination  of  th 
reliability  factors  to  be  assigned  the  data  provided  to  the  data  bank. 
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The  programming  language  to  he  utilized  is  FORTRAN,  and  all  subprograms 
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are  to  be  developed  as  "stand-alone"  routines.  This  approach  allows 
subprograms  developed  in  one  application  to  be  used  in  other  cases  whole 
the  same  algorithm  is  needed. 

5.  User  access  to  the  available  programs  should  be  through  a  simple  control 
language.  The  control  language  chosen  is  one  that  has  been  developed 
by  Prof.  Robert  J.  Dirkman  at  the  University  of  Lowell.  Although,  the 
initial  intent  was  to  incorporate  all  programs  in  a  system  package, 
linked  through  this  common  control  language,  the  core  memory  require¬ 
ments  for  such  a  system  dictate  against  doing  so. 

Using  the  objectives  stated  above,  a  number  ol  programs  have  been  developed 
and  made  operational  on  the  A.F.G.L.  Cyber  74/7s  Shared  Computer  System.  These 
programs  are  grouped  according  to  the  following  functions: 

Tape  Editing  and  Tape  Error  Analysis 
Raw  Data  File  Generation 
Sensor  Performance  and  Analysis 
Data  Searching  Procedures 

Data  Stripping  into  Minute,  Second,  and  Four  Second  Data  Files 
Generation  of  the  OPAQUE  Data  Bank  Files 
Data  Plotting  and  Data  Selection  Display 
It  should  be  noted  that  the  original  program  design  was  carried  out  on  the 
ULowell  Computer  Facilities,  which  use  the  K.RONOS  operating  system,  after  which 
they  were  transferred  and  made  operational  on  the  A.F.G.L.  Computer  System, 
which  operates  under  the  SCOPE  operating  system.  All  source  programs  arc  coded 
in  FORTRAN  and  can  he  configured  to  operate  in  either  batch  or  interactive  mode. 
This  report  will  emphasize  the  batch  mode  ol  operation  as  current Iv  installed  at 


A.F.G.l . 


I.  Overview  of  OPAQUE  Data  Processing  Procedure 

The  accompanying  flowchart,  Figure  I. A,  shows  the  sequential  processing 
steps  that  are  performed  on  the  OPAQUE  data.  The  following  comments  are  keyed 
to  this  figure  using  a  letter  code  relating  the  comment  line  to  the  flowchart 
segment  under  discussion.  Steps  A  through  F  are  discussed  in  Part  I,  which 
describes  the  tape  pre-processing  phases;  i.e.,  the  raw  data  file  generation 
and  the  sensor  performance  and  analysis.  Steps  G  through  J  are  discussed  in 
Part  II,  which  describes  the  data  searching  and  stripping  procedures,  generation 
of  the  OPAQUE  data  bank  files,  along  with  the  plotting,  selection,  and  display 
procedures . 

A  The  sequence  starts  with  the  generation  of  a  raw  data  tape  on  the  system  data 
logger  at  the  U.S.  OPAQUE  site  at  Meppen,  F.R.G.  The  data  logger  character¬ 
istics  are  given  in  Section  1.1,  and  the  raw  data  tape  format  is  described 
in  Section  1.2. 

B  A  back-up  copy  of  the  raw  data  tape  is  produced  and  stored  at  the  Meppen  Test 
Range  Computer  Center  at  Meppen,  F.R.G.  The  back-up  tape  copies  are  retained 
until  it  is  determined  that  the  original  raw  data  tape  received  at  the 
Atmospheric  Optics  Branch  is  of  usable  quality.  A  raw  tape  processing  pro¬ 
gram  was  developed  and  made  operational  by  ULowell  on  the  Meppen  Computer 
Center  TR-4  computer  to  strip  out  and  dump  selected  raw  tape  hexidecimal 
blocks  in  display  code.  This  program  is  described  in  Section  1.3. 

C  The  raw  data  tapes  are  air  mailed  to  A.T.G.L.  with  the  ULowell  research  team 
maintaining  the  raw  tape  data  bank.  The  raw  tape  data  log  is  given  in 
Section  1.4. 

D  Upon  receipt  at  A.F.G.L.,  each  raw  data  tape  is  edited  to  determine  the 
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OPAQUE  Data  Processing  Sequence  -  Figure  I. A 


quality  of  the  data  recording,  vis,  the  number  of  invalid  hex  characters, 
the  number  of  data  and  time  word  format  errors,  the  number  of  block  size 
errors,  and  end-of-record  (EOR)  and  end-of-file  (EOF)  mark  errors.  The 
data  tape  utility  program  ILLCHAR,  described  in  Section  1.5  is  used  to 
perform  this  analysis.  The  data  file  is  rewound  and  the  sensor  performance 
program  STRPHEX  is  executed.  The  output  of  STRPHEX  is  a  coded  presentation 
that  displays  each  active  data  channel  over  the  complete  time  interval  of 
the  raw  data  tape,  usually  three  davs.  In  addition,  STRPHEX  can  also  pro¬ 
duce  a  histogram  plot  for  each  active  data  channel  for  the  raw  tape  dura¬ 
tion.  A  complete  description  of  STRPHEX  is  given  in  Section  1.6. 

The  printouts  produced  by  BADCh'AR  and  STRPHEX  are  reviewed  to  identify  po¬ 
tential  problem  areas  in  the  data  stripping  and  sequencing  phases.  Analy¬ 
sis  of  the  STRPHEX  outputs  assists  in  determining  current  sensor  status  and 
operational  values. 

The  raw  data  tape  is  rerun  and  the  program  BLOCK  produces  a  data  file  of 
uniform  block  sizes  on  the  private  disk  pack,  MDATA1.  Four  consecutive 
raw  data  tapes  are  blocked  and  loaded  to  the  disk  pack  for  additional  pro¬ 
cessing.  A  discussion  of  the  program  BLOCK  can  be  found  in  Section  1.7. 

It  should  be  noted  that  the  raw  tape  or  the  disk  pack  raw  data  file  can  be 
rerun  with  the  program  STRPHEX  to  obtain  "quick-look"  plots  of  selected 
sensor  voltage  outputs  or  sensor  data  frequency  of  occurrence. 

The  next  phase  involves  stripping  the  one  minute  samples  from  the  raw  data 
disk  files  on  the  disk  pack  MDATA1  and  packing  and  formatting  these  samples 
into  the  monthly  minute  files  on  svstera  storage.  Entries  are  made  into 
the  associated  minute  file  directory  regarding  the  time,  date,  and  duration 
and  file  address  of  each  raw  data  entry.  An  overview  of  the  data  stripping 
and  file  generation  process  is  given  in  Part  II. 


The  one  minute  data  channel  stripping  program,  NEWSTRIP,  is  described  in 
Section  II. 1.  A  similar  procedure  is  used  to  strip  the  four  second  illumination 


data  from  the  Luxmeter  into  the  monthly  Luxmeter  file  and  directory  using  the 
program  STRPLX  described  in  Section  II. 2.  The  Variable  Path  Function  Meter  (VPFM) 
data  are  also  stripped  from  the  raw  data  files  on  a  monthly  basis  using  the  pro¬ 
gram  STRPVS,  which  is  described  in  Section  II. 3.  To  assist  in  the  user  interface 
with  the  program  packages,  a  JOB  control  card  procedure  file  has  been  developed 
for  each  of  the  three  stripping  operations  above,  named  M1NSTRIP,  LUXSTRIP,  and 
VISSTRIP.  These  procedure  files  contain  the  appropriate  SCOPE  control  cards 
stored  sequentially  and  executed  by  a  control  card  call  to  the  procedure  file. 

The  contents  of  the  monthly  stripped  data  files  and  their  associated  directories 
can  be  audited,  depending  on  the  file  contents,  using  one  of  the  status  procedure 
files  FILES  TAT,  II'XSTAT,  or  V1SSTAT. 

11  As  each  of  the  three  types  of  monthly  stripped  data  files  is  completed,  it  is 
copied  onto  the  private  disk  pack,  LOWELL,  along  with  its  associated  directory. 
When  three  consecutive  months  of  data  has  been  stripped  and  loaded  onto  the 
private  disk  pack,  a  back-up  copy  of  the  contents  ol  the  private  pack  is  made 
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A  back-up  copy  of  the  OPAQUE  data  bank  files  is  stored  on  CC  tape  for  future 
use . 

The  sequence  is  then  repeated  for  additional  raw  data  tapes. 

The  sequence  described  above  was  designed  to  handle  the  raw  data  tapes  on 
either  a  production  basis  or  a  single  tape  job  run  using  system  procedure  files 
that  load  and  execute  the  appropriate  main  program  and  the  required  subprograms. 
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1.1  DATA  LOGGER  SYSTEM 


The  Data  Logger  System  used  in  the  collection,  formatting,  and  recording 
of  the  data  sensor  outputs  was  designed  and  developed  at  A.F.G.L.  based  on 
an  Intel  8008  microprocessor.  The  basic  system  consists  of:  eight  program- 
controlled  input  ports,  eight  program-controlled  output  ports,  a  fourteen 
bit  address  bus,  an  eight-bit  buffered  data  bus,  2,256  bytes  of  RAM  and  256 
bytes  of  PROM  memory,  along  with  a  microprocessor  controlled  IEEE-488  pro¬ 
grammable  interface  bus.  The  basic  design  criteria  used  was  to  retain  com¬ 
plete  system  control  in  the  memory-resident  software  control  algorithm  to 
allow  maximum  flexibility  in  sensor  sampling  time,  sequencing,  data  format¬ 
ting,  and  recording. 

The  processor  communicates  with  the  experimental  instrumentation  and 
the  system  peripherals  (i.e.,  the  teletype,  the  magnetic  tape  recorder,  the 
system  time/day  clock,  and  the  analog-to-digital  converter)  through  the 
eight  line,  bidirectional,  buffered  data  bus.  Digital  information  is  pro¬ 
vided  to  the  microcomputer  in  groups  of  eight  bits,  each  bit  being  two¬ 
valued;  i.e.,  1  or  0.  These  groups  of  8-bitr.  constitute  a  bvte ,  and  pro¬ 
visions  are  made  in  the  design  to  accept  eight  separate  data  input  sources 
(called  INPUT  ports).  These  input  sources  can  represent  either  STATUS  in¬ 
formation  (i.e.,  the  current  state  or  phase  of  operation)  or  DATA  from  an 
external  device. 

In  turn,  the  microcomputer  can  send  out  8-bit  bytes  on  the  data  bus  and 
latch  or  store  these  bytes  in  any  of  the  eight  OUTPUT  registers.  The  bytes 
stored  in  these  output  registers  represent  either  a  COMMAND  or  a  DATA  bvte 
to  the  external  devices. 

The  functional  block  diagram  in  Figure  I.l.A  shows  the  data  logger  with 
its  eight  INPUT  ports  and  the  eight  OUTPUT  registers.  From  this  figure  one 
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can  note  that  the  microprocessor  can  provide  a  mapping  of  the  eight  input 
bytes  onto  the  eight  output  registers.  The  dominant  aspect  of  the  figure 
io  that  the  microprocessor  forms  the  "link"  between  the  INPUT  ports  and 
the  OUTPUT  registers.  Thus,  through  the  use  of  the  appropriate  control 
program  (software,  stored  in  memory)  the  microprocessor  can  "link"  any 
INPUT  port  to  any  OUTPUT  register(s)  ,  determine  the  STATU?  of  anv  connecter: , 
external  device,  or  issue  a  COMMAND  to  anv  external  device.  As  all  dat 
bytes  pass  through  the  processor  from  INPUT  to  OUTPUT,  additional  control 
operations,  such  as  data  formatting,  can  be  performed  on  data  bytes  while 
passing  through  the  data  logger. 

The  central  role  that  the  processor  plays  is  its  ability  to  test  for 
the  current  STATUS  of  a  given  device,  the  abilitv  to  accept  TATA  from  a 
device,  the  ability  to  COMMAND  a  device  to  perform  a  specific  operation  or 
function,  and  to  provide  DATA  to  a  specific  device,  all  under  the  control 
of  a  program  demonstrates  the  power  of  a  software  control  structure.  Essen¬ 
tially,  one  writes  a  short  program  to  control  each  an„  everv  device  con¬ 
nected  to  the  data  logger.  These  control  programs  are  tailored  to  the 
characteristics  of  the  devices  and  form  the  software  control  interfaces. 

The  hardware  portion  of  the  interface  resides  in  the  device  assigned  INPUT 
port(s)  and  OUTPUT  register(s). 

In  summary,  the  concept  of  separating  the  control  structure  into  its 
hardware  and  software  segments  yields  considerable  flexibility  and  versa¬ 
tility  to  the  data  logger  design.  Although  onlv  eight  INPUT  sorts  ,-nd 
eight  OUTPUT  registers  are  current!',’  provided,  additional  norts  and  register’ 
can  be  added  by  providing  the  necessary  hardware  and  the  software  ar.tr a. 


programs . 


1  (uL  n_S »  SuquetH  i  ;ig ,  anti Format  Control  Programs 

The  data  logger  design,  being  microprocessor  based,  separates  the  control 
structure  into  hardware  and  software  segments.  The  hardware  segment  provides 
eight  programmable  input  ports  and  eight  programmable  output  ports.  The  input 
ports  allow  entry  of  digital  information  from  sources  external  to  the  data 
logger  representing  either  STATUS  information  or  DATA.  The  output  ports  provide 
either  COMMAND  information  or  DATA  to  external  devices.  In  it  ^  simplest  form, 
the  data  logger  provides  a  mapping  of  the  eight  input  ports  onto  the  eight  output 
ports.  The  control  programs  necessary  to  perform  this  mapping  reside  in  a  2K 
random  access  memory  in  the  data  logger. 

The  flowchart  given  in  Figure  1.1.8  shows  the  sequential  control  structure 
used  to  implement  the  software  portion  of  the  design  algorithm.  The  flexibility 
of  the  design  is  retained  through  the  use  of  a  short  MAIN  program  that  calls 
the  modular  subprograms  in  the  order  shown.  All  data  input  and  output  operations 
are  in  the  programmed  I/O  mode  with  reserved  memory  buffer  areas  available  to 
the  control  program  segments.  The  algorithm  is  cyclical  in  operation  and  runs 
continuously  under  the  control  of  system  STATUS  "flags".  These  one  bit  signal 
lines  are  monitored  by  the  program  and  cause  system  WAIT  or  system  HALT,  depend¬ 
ing  on  the  monitored  signal.  HALT  conditions  are  typically  END-of-TAPE, 
peripheral  not  READY,  etc. 

The  data  logger  dynamic  performance  can  be  monitored  through  the  switch- 
programmable  panel  display  in  octal  or  decimal  digits  and  through  the  use  of 
the  utility  program,  QLOOK,  that  produces  an  ASCII  formatted  printout  on  the 
teletype  of  the  most  recent  256  hexidecimal  data  bytes  written  to  the  magnetic 
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FIGURE  1.1. B  Data  Logger  Control  Algorithm 


Based  on  the  NATO/OPAQUE  data  sampling  rates  and  frequency,  a  complete  set 
of  control  programs  has  been  designed  and  developed.  A  combination  memory  map 
and  listing  of  the  programs  that  are  currently  operational  at  the  Meppen  Field 
Station  is  given  below. 


l 

Address 

Name 

Func  t:  ion 

0 

70-212 

MAIN 

The  primary  control  sequence  procram 

0 

250-333 

CH  Test 

Analog  channel  service  program 

i 

200-312 

TIME 

Stores  time  values  ai.c.  determines  one 
second  and  one  minuti  time  changes 

1 

000- lo2 

CLOCK 

Control  pro-cram  for  HP  Interface  Bus 
addresses  and  reads  digital  clock 

1 

320-367 

TPTFMT 

Time  Print/Reccrd  Format  Control 

-I 

000-07* 

TYMSYN 

Determines  four  second,  ten  minute,  and 
thirty  minute  intervals 

2 

07  7-  1  !  3 

STCK 

Determines  status  of  magnetic  tape  reeorde 

2 

030-  50 

SCANSEC 

Determines  odd  or  even  hour 

7 

:  a-  i  _ 

Ll'XSEC 

Detects  four  second  intervals 

7 

1 50- i 7* 

LUXI.0G 

Synchronizes  second  counter  to  minute 
time  chances 

"i 

140-177 

BLKSZ 

Fixes  block  size  of  digital  data  re¬ 
corded  on  tape 

o 

200-222 

MRCDR 

Controls  the  operation  of  the  magnetic 
tape  recorder 

2 

260-302 

SHIFT 

Controls  the  circular  shifting  of  a  twelve 
byte  array-variable  number  of  shifted 
posi t ions 

2 

320-377 

PACKER 

Stores  eight  or  six-bit  ASCII  values 
in  BCD  form 

1 

000-025 

DPTFMT 

Data  Print/Record  Format  Control 

3 

100-140 

HOUSE 

Discrete  channel  control  array 

3 

300-340 

REQST 

Analog  channel  control  array 

4 

000-061 

DIGMl'X 

Digital  Multiplex  control  program 

4 

200-303 

CLEAR 

System  initialization  program 

7 

210-240 

QLOOK 

Prints  last  256  analog  channel  samples 
on  system  teletype  in  A.--C1I 

6 

200-243 

MIN 

Outputs  one  minute  commands  to  system 
experiment s 

6 

100-122 

CRLF 

Carriage  return/line  feed  control  for 
the  teletype 

I  3. 
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Page 

Address 

Name 

Func  t ion 

4 

100-133 

TWTFMT 

Time  word  format  control  programs 

4 

140-162 

DWTFMT 

Data  word  format  control  program 

5 

000-047 

BINLD 

Binary  loading  routine  for  system 
generated  paper  type 

5 

100-163 

PDUMP 

Program  to  punch  paper  tape 

5 

200-247 

PROGIN 

Keyboard  input  routine 

5 

300-372 

MDUMP 

Program  to  print  in  ASCII 

6 

000-062 

PNTB1N 

Conversion  program,  octal  to  ASCII 

0 

250-267 

BLKCTR 

Taper  recorder  block  counter  program 

6 

300-357 

INSTIN 

Enter  machine  instructions  from  kev- 
board  to  memory 

- 

000-032 

LOADER 

Binary  tape  loading  routine 

7 

050-060 

LDLINK 

Linking  routine,  used  with  QLOOK 

7 

242-273 

XFER 

Array  transfer  and  format  program 

7 

300-341 

ADTEST 

Analog  channel  address  and  display 
program 

7 

342-372 

ENDE 

Terminates  recording  at  the  end  of  the 
current  block 

Tin 

i  programs  QLOOK, 

BINLD,  PDUMP, 

MDUMP,  INSTIN,  ADTEST,  and  ENDE  are 

utility 

Programs  used  for 

modification 

,  testing,  and  diagnosis. 
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1.2  Raw  Data  Tape  Format 

The  data  recording  format  used  consists  of  a  time  word  followed  by  the  data 
words  for  all  channels  to  be  sampled  at  that  time.  The  asynchronous  channel  samp¬ 
ling  used  results  in  data  word  strings  of  various  lengths.  Each  data  channel  can 
be  programmed  such  that  it  is  sampled  at  one  or  more  of  the  following  rates: 
each  minute,  continuously 

each  minute  for  the  first  ten  minutes  of  each  hour 

each  second  for  the  first  ten  minutes  of  each  hour 

each  second  for  the  first  thirty  minutes  of  alternate  hours 

every  four  seconds,  continuously 

Other  sampling  rates  can  be  programmed  as  required. 

A  typical  sample  time  string  is  given  below  where  the  three  characters,  ???, 
signify  the  start  of  a  time  word  and  the  character,  =  ,  signifies  the  start  of  a 
data  word. 

???345120155  =  11007954  =  12006316  =  13006156  =  31457172  =  32466008  =  33464002 
=  34466296??? 

345120156  =  . 

As  detailed  in  Table  I. 2. A,  the  day,  hour,  minute,  and  second  value  in  the 
sample  above  is  day  345  and  time  12:01:55.  The  channel  number  appears  after  the 
data  word  sync/separator  character,  =  .  The  channels  in  the  sample  above  are  11, 
12,  13  (VPFM  samples),  and  31,  32,  33,  34  (Scanning  Nephelometer  samples).  This 
sample  string  is  followed  by  the  next  time  word  given  as  day  345  at  12:01:56  and 
the  next  string  of  data  words  separated  by  the  =  character.  The  example  above  is 
generated  from  the  packed,  hexidecimal  raw  tape  where  the  hex  codes  are  converted 
to  display  codes.  When  originally  installed,  the  data  logger  was  programmed  to 
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to  record  a  packed  6-bit  ASCII  subset  code  but  was  reprogrammed  for  the  4-bit 
hexidecimal  codes  to  conserve  magnetic  tape. 

A  detailed  description  of  the  data  channel  assignments,  sampling  rates,  and 
the  data  word  field  use  is  given  in  Table  I. 2. A. 


TABLE  I. A. A 


Raw  Data  Tape  Formats 

Time  Word  Format  -  twelve  4-bit  Hex  characters  as 

???dddhhmmss  where  ???  identifies  the  start  of  a  time  word 

ddd  is  dav  of  year 
hh  is  hour  of  day 
mm  is  minute  of  day 
ss  is  second  of  day 

The  time  word  identifies  the  start  time  of  the  ana J og  data  channel  sampling 
sequence . 


Data  Worn  Format  -  nine  -t-bit  Hex  characters  as 

=ecddaaaa  where  =  identifies  the  start  of  a  data  word 

cc  is  the  analog  channel  number 
dd  is  the  discrete  channel  value 

aaaa  is  the  number  of  "counts",  proportional  to  the 
analog  voltage  input 

Instrument  Sampling  Rates 

The  various  sensors  are  sampled  at  one  of  the  following  rates: 
every  minute,  continuously 

every  minute  tor  the  first  ten  minutes  of  the  hour 
every  second  for  tile  first  ten  minutes  of  the  hour 
every  four  second,  continuously 

every  second  for  the  first  thirtv  minutes  of  alternate  hours 

The  standard  OPAQUE  reporting  period  is  the  first  ten  minutes  of  every  hour, 
indicated  above,  many  of  the  sensors  are  sampled  through  the  whole  hour, 
and  these  non-OPAQl'E  samples  will  be  reported  separately. 


INSTRUMENT  DATA  WORD  FORMAT  SAMPLE  RATE  SENSOR/OUTPUT 


MRI  =0000mnnn 

1 

minute,  cent. 

Channel  1 

N'EPHELOMETER  =0100mnnn 

1 

minute,  cent. 

Channel  2 

(before  Apr . 78)=0200mnnn 

1 

minute,  cont. 

Channel  3 

=0300mnnn 

1 

minute,  cont. 

Channel  4 

AEG  POINT  =0000mnnn 

1 

minute,  cont. 

Channel  1 

VISIBILITY  METER 

(after  Mar.  78) 

0=Run 

ELTRO  VISIBLE  =04xgmnnn 

8  = 

TRANSMI SSOMETER 

l=Cal 

1 

minute,  cont. 

Transmission 

NIGHT  PATH  =0500mnnn 

1 

minute,  cont. 

Filter 

RADIANCE  METER  =0600mnnn 

1 

minute,  cont. 

Radi  am  e 

=0700mnnn 

1 

minute ,  cont . 

Range 

As 


INSTRUMENT 


DATE  WORD  FORM VI 


Vl’FM 


LASER 

NEPHELOMETEK 


TURBULENCE 
(500  m  BARNES 
IR  TRANS.) 


BARNES  (500m) 
IR  TRANS. 


BARNES  (1500m) 
IR  TRANS . 


RAIN  Gauge 


ILLUMINOMETER 


SCANNING 

NEPHELOMETER 


)ATE  WORD  F( 

IRMAT 

SAMPLE  RAT 

S hV  ..  Ji\  /  0\  :  ■’ 

-- 1  lOOmnnn 
=  1200innnu 
=  !  300mnnn 

!  second ,'10  min 
j  seconc  ' !. 0  in i i 

I  secondUO  min 

Phote  Met*/!' 

:\y.  imut  n 

-1400mnnn 
= 1 500mnnn 
=1600mnnn 
=1700mnnn 

L  minute,  rent. 

]  mi  nut  e ,  run t ■ 

L  minute,  eont. 

:  minute,  runt. 

=20xfmnnn 

O 

f  =  1  filter 

2  position 

J.  minute,  cont. 

D.C.  signal 

0 

f  =  1  filter 

=21xfmnnn  2  position 

3 


i  minute,  cent. 


Transmiss ion 


0 

f  =  1  filter 

=22f xmnnn  2  position 

3 


1  minute,  cone . 


Transmission 


=2300mnnn 


1  minute,  cont .  Rain  Level 


=24gxmnnn  0 

=25gxmnnn  g  =  1  gain 
=26gxmnnn  3 


4  seconds,  cont. 

4  seconds,  cont. 
4  seconds,  cont. 


Vertical  Sensor 

Horizontal  Sensor 
Azimuth 


=31gfmnnn  0 

=32gfmnnn  g  =  to  gain 
3 


1  second/ 30  minA  Angle  of  Rotn. 
1  second/30  minA  Scale  Shift 


=33gfmnnn  0 

=34gfmnnn  f  =  to  filter 
7 


1  second/30  minA  Photo  Diode 

1  second/30  minA  Monitor 


f 


INSTRUMENT  DATA  WORD  FORMAT  SAMPLE  RATE  SENSOR/OUTPUT 

0 

EPPLEY  =36xxmnnn  g  =  to  gain  1  minute,  cont.  Direct  Channel 

PYROHELIOMETER  3  sun  sensor 


1 

=37gfmnnn  f  =  to  filter  1  minute,  cont.  Filtered  Channel 

9 

Note:  In  the  data  word  format,  x  =  do  not  care,  f  =  discrete  filter  value, 
g  =  discrete  gain  value,  m  =  high  order  digit  of  A/D  count,  and 
n  =  lower  three  digits. 

A  =  alternate  hours 


The  utility  program  OPAQUE  was  developed  for  use  on  the  TELEFUNKEN  TR-4  computer 
system  at  Meppen.  This  program  is  a  modification  of  the  function  subprograms  ICHAR 
and  NDIF  and  the  subroutine  DATE  used  in  the  main  program  STRPHEX  described  in  Sec¬ 
tion  I.t>.  The  implementation  of  this  program  presented  several  p  jblems  in  that  the 
FORTRAN  ron’-i'-.os  M'FFER  IN,  BUFFER  OUT,  and  SHIFT  are  non-existant  in  the  TR-4  ver¬ 
sion  oi  FORTRAN.  The  program  ran  correctly  on  our  second  try,  but  turn-around  time 
was  ,;uite  long  due  to  the  machine  cycle  time. 

The  final  version  of  OPAQUE  allows  the  user  to  skip  a  specified  number  of  tape 
records  and  convert  the  hex  characters  to  displav  codes  and  print  the  next  record. 

The  program  is  used  to  assist  the  field  personnel  in  determining  the  quality  of  the 
raw  tape  and  in  debugging  system  problems  at  the  Meppen  Computer  Center. 


I .  Raw  Tape  Log 


The  raw  data  tapes  are  sequentiallv  numbered  for  identification  and 
cataloging  purposes.  The  tape  assignment  is  made  at  the  Meppen  field  site 
using  the  prefix  OPA  and  a  three  digit  number.  The  raw  data  tape  log  is  kept 
on  the  CYBER  74/74  system  file,  TAPEFILE,  and  can  be  listed  out  in  two  formats. 
The  first  is  a  sequential  tabulation  by  OPA  tape  number  giving  the  starting 
day  of  year  and  hour  and  the  ending  day  of  year  and  hour.  The  second  format 
is  a  yearly  mapping  of  data  recordings  using  the  day  of  montn  as  the  ordinate 
and  the  month  of  year  as  the  abscissa  with  the  OPA  tape  number  indicating  the 
daily  AN  and  PM  coverage. 

The  mapping  for  data  year  1974  is  given  in  Figure  1.4. A,  the  data  year 
1977  is  given  in  Figure  I.4.B,  and  the  data  year  1978  (updated  to  June,  1978) 
is  given  in  Figure  i.'«.i  . 

A  sample  of  the  sequential  tabulation  is  given  in  Figure  1.4.1)  for  the 
current  data  year  1978. 
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FIGURE  I.4.D.  DATA  TAPE  LISTING,  JANUARY- JUNE,  1978 


1.5  UTILITY  PROGRAM  ILLCHAR 


The  program  ILLCHAR  determines  the  total  number  of  invalid  hex  characters 
per  tape  record,  the  total  number  of  invalid  characters  over  the  recorded  length 
of  the  tape,  the  total  number  of  all  characters  recorded,  and  the  percent  error. 

The  program  also  detects  changes  in  tape  record  sizes,  which  for  a  perfect  tape 
remains  fixed  at  3060  characters  per  record.  This  program  can  be  used  in  two 
modes  of  operation.  The  tally  mode  accumulates  the  total  number  of  records  read, 
the  total  number  of  bad  characters,  the  total  number  of  characters  read,  and  the 
total  number  of  records  with  bad  characters.  Any  change  in  record  size  is  printed 
out  along  with  the  record  number  at  which  the  size  changed.  This  mode  is  used  to 
determine  the  quality  of  the  raw  data  tape  and  assists  in  determining  the  amount  of 
preprocessing  required  by  a  given  data  tape. 

The  second  mode  of  operation  allows  a  more  detailed  analysis  of  the  characters 
in  error  by  printing  the  location  within  the  record  and  the  invalid  character  codes 
as  :  ;  <  >  .  A  raw  dump  of  the  tape  in  the  region  about  the  illegal  character  allows 
the  user  a  means  to  correct  the  character.  A  modification  to  this  mode  checks  the 
data  format  on  the  tape  as  being  one  of  the  two  allowed  patterns;  i.e.,  the  twelve 
character  time  tag  sequence  or  the  nine  character  data  value  sequence.  This  mode 
of  operation  is  intended  for  interactive  use. 

This  program  package  allows  data  recovery  procedures  useful  in  those  cases 
where  a  character  is  incorrectly  recorded  and/or  reproduced.  It  is  also  a  neces¬ 
sary  adjunct  to  the  system  provided  routines  for  processing  stranger  types  on  the 
Cyber  70  systems  at  AFC.L  and  Lowell.  The  flowchart  for  ILLCHAR  is  given  in 
Figure  I. 5. A  and  a  sample  of  the  program  output  is  given  in  Figure  I.5.B. 
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TOTAL  BLOCKS=120  TOTAL  BAD  BLOCKS=6  BLOCK  PCT.  ERROR=5.0 

TOTAL  NO.  CHAR=316710  TOTAL  BAD  CHAR=21558  PCT.  ERROR=6.8 

TOTAL  BLOCK  SIZE  CRANGES=90  in  120  BLOCKS  PCT.  SIZE  ERROR=  15 


Kijoire  I.5.B.  Sample  Output  of  ILLCUAR 


1.6  Raw  Tape  Program,  STRPHEX 

The  sensor  performance  and  analysis  program,  STRPHEX,  was  developed  to  process 
raw  data  tapes  or  raw  data  files  and  can  be  executed  in  either  the  interactive  or 
batch  mode  of  operation.  In  the  interactive  mode,  the  user  can  request  any  avail¬ 
able  option  and  then  the  system  prompts  the  user  for  the  necessary  responses.  The 
batch  mode  requires  the  use  of  fixed  format  control  cards  that  perform  the  requested 
system  options  during  the  job  run. 

The  options  available  in  STRPHEX  are: 

1.  Print  selected  portions  of  a  raw  data  tape  (file)  converting  the  b-bit 
ASCII  or  (lexidecimal  data  coding  to  printer-display  characters. 

2.  Generate  a  60  line  by  120  column  line  printer  output  that  summarizes 
the  activity  ol  each  analog  channel  called  a  PROFILE  plot. 

3.  Collect  all  the  data  samples  recorded  on  the  raw  data  tape  Uiie)  for 
up  to  eight  selected  analog  channels  over  the  specii ieu  time  interval. 
The  data  collected  ls  stored  in  a  program  array  tor  use  by  the  remain¬ 
ing  three  options. 

4.  Produce  a  signal  voltage  vs  time  plot  for  all  the  analog  data  collected 
in  Option  3. 

5.  Produce  a  plot  that  displays  the  frequency  of  data  points  at  their  re¬ 
spective  analog  voltage  values  within  the  abscissa  time  intervals. 

6.  Produce  a  histogram  plot  giving  the  number  of  data  samples  at  each 
signal  level  for  the  total  time  interval  selected. 

Additional  options  can  be  added  to  this  svstem  program  he  the  addition  ol  the  re¬ 
quired  linking  program  to  the  main  procram,  STKP1H.X,  and  assigning  one  of  the 
unused  option  codes.  The  operational  ieatures  ol  each  ol  the  active  options  is  liven 
below,  and  the  general  STRPHEX  1 1  owe hart  appears  in  !  igure  1.6. A. 
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Option  1,  Raw  Data  Dl'MP 


This  option  is  a  utility  routine  to  print  out  the  contents  of  a  data  tape 
(file).  The  control  card  allows  the  data  "dump"  to  start  at  either  the  begin¬ 
ning  of  information,  the  current  tape  position,  or  at  a  particular  time  and  day 
on  the  data  tape  (file) .  The  user  determines  the  quantity  of  output  and  the 
time  duration  dumped  by  specifying  the  number  of  lines  of  output.  (See  Figure  I.6.B). 

Option  2,  PROFILF.  Plots 

The  PROFILE  option  was  developed  to  meet  the  need  for  a  compressed  form  of 
display  of  all  active  sensor  channels  over  time  intervals  ranging  from  two  hours 
to  over  three  days.  Each  of  the  rows  in  the  plot  represents  an  active  sensor 
channel,  and  a  letter  code  is  used  to  represent  the  average  of  all  the  one  minute 
data  samples  collected  for  the  time  interval  displayed.  The  conversion  for  the 
letter  codes  representing  the  user  select  scale  (either  millivolts  or  A/D  "counts") 
is  printed  below  each  plot.  The  time  duration  represented  by  each  printed  letter 
code  is  given  by  the  totai  plot  time  in  minutes  divided  by  120. 

Two  useful  extremes  then  are  the  two  hour  PROFILE  plots  and  the  whole  raw 
tape  (file)  PROFILE  plot.  The  two  hour  PROFILES  display  the  sensor  outputs  on  a 
minute-by  minute  basis  for  120  minutes  and  yield  a  detailed  analvsis  method  for 
determining  sensor  performance.  Specifying  the  total  raw  tape  time  duration  in 
minutes  yields  a  single,  compressed  Profile  plot  giving  all  sensor  outputs 
averaged  over  30  or  40  minutes  per  point.  This  presentation  is  useful  in  deter- 
minin  longer-term  sensor  performance.  Intermediate  time  intervals  such  as  4,  8, 

12,  or  24  hours  can  also  be  readily  produced,  the  general  theme  being  that  the 
clustering  or  scattering  of  the  sensor  outputs  about  various  values  allows  one 
to  asse  .s  performance  and  establish  short  and  long  term  data  reliability  figures. 

The  control  card  for  this  option  allows  selection  of  the  starting  point  tor 
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the  PROFILE  plot,  specification  of  the  duration  of  the  plot  in  minutes,  the  scale 
to  be  used  in  the  plot,  the  optional  generation  of  a  histogram  for  each  active  data 
channel,  and  a  PROFILE-type  plot  giving  the  number  of  occurrences  of  each  sensor 
for  the  plot  abscissa  values  rather  than  sensor  output  values.  The  options  al¬ 
lowed  with  PROFILE  are  shown  in  Figure  I. 6. A,  the  STRPHEX  flowchart.  (See  PROFILE 
Figure  I.6.C) . 

Option  3,  Collect  Data  Routine 

The  remaining  three  options  utilize  a  pre-loaded  data  array  that  is  loaded 
from  the  raw  data  source  by  the  routine,  COLLD;  i.e.,  collect  data.  The  control 
card  for  this  option  allows  user  specified  starting  time  and  the  duration  of  the 
data  collection  interval  in  minutes  along  with  the  channel  numbers  (up  to  eight) 
for  which  the  data  is  to  be  collected.  (See  Figure  I.6.D). 

Option  4,  Plot  Sensor  Output 

This  routine  presupposes  that  COLLD  has  previously  been  run  to  collect  the 
data  for  the  sensor  output  that  is  to  be  plotted.  The  user  can  specify  the 
starting  time,  the  time  duration  of  the  plot  with  one  or  two  discrete  channels 
plotted  at  the  top  of  the  display.  The  plot  is  automatically  scaled  based  on 
the  minimum  and  maximum  values  and  allows  for  the  selection  of  linear  or  logarithmic 
scale.  (See  Figure  I.6.E). 

Option  5,  Plot  Sensor  Output  Frequency  Values 

As  a  variation  to  Option  4,  this  option  produces  a  plot  identical  in  all  re¬ 
spects  to  Option  4  except  that  the  display  characters  reflect  the  time  sequence 
of  the  data  points  within  the  abscissa  time  increments.  It  is  useful  when  used 
with  Option  4  to  determine  the  time-ordered  sequence  of  values  that  are  averaged 
for  each  point  in  the  sensor  output  voltage  plot.  (See  Figure  I.6.F). 
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FIGURE  I.6.C.  PROFILE  OPTION  FOR  4  DAY  INTERVAL 
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DATA  COLLECTION.  CURVE 
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FIGURE  I.6.D.  SAMPLE  DATA  COLLECT  OUTPUT 


FIGURE  I.6.E.  PLOT  SENSOR  OUTPUT  SAMPLE .TRANSMIS SOME TER  DATA  FOR  1  DAY 


FIGURE  I.6.F.  FREQUENCY  OF  OCCURRENCE  PLOT, TRANSMISSOMETER  DATA  FOR  1  DAY 


Option  6,  Histogram  Plotting 


With  this  option,  the  data  collected  under  Option  3  can  be  used  to  produce 
a  histogram  display  for  any  or  all  of  the  sensor  outputs  stored  in  Option  3. 

The  careful  reader  will  note  that  the  Options  4,  5  and  6  all  require  the 
previous  use  of  Option  3  to  collect  the  data  into  a  program  array.  These 
routines  were  designed  to  be  used  on  the  raw  data  for  quick  editing  and  pre¬ 
liminary  analysis  operations.  These  options  are  most  useful  when  used  on  an 
interactive  terminal  in  the  study  of  selected  sensor  outputs  over  limited  time 
durations.  (See  Figure  I.6.G). 

The  overall  program  design  of  STRPHEX  is  seen  in  the  subprogram  linkage 
diagram  given  in  Figure  1.6.H,  where  the  re-linking  and  re-use  of  a  small  number 
of  routines  allows  additional  options  to  be  easily  developed.  An  example  of  this 
approach  is  the  subroutine  AUTOGM,  which  can  be  linked  into  the  Option  2  PROFILE 
plots  through  the  control  card  and  also  the  ability  to  "parade"  through  a  data 
source  file  with  a  fixed  time  increment  from  the  beginning  to  the  end  of  the 
information. 

While  the  plots  produced  in  Options  4,  5  and  6  are  not  in  scientific  units, 
the  inclusion  of  the  instrument  calibration  programs  in  STRPHEX  as  a  user  selected 
feature  could  be  provided  if  deemed  necessary. 
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FIGURE  I.6.G.  HISTOGRAM  PLOT  FOR  4  DAYS  DURATION, SAMPLING  NEPHELOMETER  DATA 
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1 


main  STRPHEX 
— ,-ICHAR 

- »- NOFIND 

- »»  UPDATE 

- PROFILE 


- - >-COLLD 

*= - v  PLOTIT 

■= - HISTGM 


-».NDIF 


COUNT 


K - ^FILLD 


-^■PRINTD 


-a^AUTOGM 


sub  COLLD 
— ^-ICHAR 
— -,-NDIF 
—v  DATE 
— »»  COUNT 


return 


exit 


return 


sub  PLOTIT 

- «p>  SCALE 

— —  MANIT 
- w-  PRGAIN 


sub  AUTOGM 
- a-NAMIT 


return 


Sub  SCALE 
— s*SFUN 
return 


sub  COUNT 
— s^ICHAR 


return 


return 


sub  DATE 


.  I CHAR 


return 


return 


sub  PRINTD 
— ^NAMIT 
— »-UPDAT 
return 


FIGURE  I.6.H.  STRPHEX  Subprogram  Linkages 
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1.7  Utility  Program  BLOCK 


While  the  data  logger  system  is  programmed  to  produce  raw  tape  records  of 
3060  hexidecimal  characters,  records  of  greater  and  less  lengths  are  frequently 
encountered.  The  tape  utility  program,  BLOCK,  was  developed  to  reblock  input 
records  of  varying  lengths  into  output  records  of  a  fixed  size.  The  algorithm 
used  may  be  likened  to  two  circles,  each  rotating  at  a  different  velocity  that 
transfer  tape  characters  through  a  storage  array.  The  input  raw  tape  record  of 
tape  characters  is  stored  on  the  periphery  of  the  input  circle.  The  input  circle 
is  then  indexed  to  the  first  character  and  the  record  of  characters  is  transferred 
to  the  storage  array,  starting  at  the  next  open  position  in  the  array.  The  load¬ 
ing  of  the  tape  characters  from  the  input  circle  to  the  storage  array  is  interrupted 
when  the  storage  array  has  accumulated  a  fixed  number  of  characters  which  are 
then  transferred  to  the  output  circle.  The  output  circle  also  interr  pts  the 
transfer  process  when  it  has  received  the  number  of  characters  determined  by  the 
output  block  size.  The  fixed  block  of  characters  is  then  transferred  from  the 
output  circle  to  the  disk-based  data  file  and  the  process  continues.  The  input 
circle  also  interrupts  the  process  when  it  becomes  empty  and  reads  in  a  new  rec¬ 
ord  of  raw  data  to  be  blocked.  The  process  continues  until  the  end  of  information 
mark  is  detected  on  the  raw  data  tape  files.  Character  processing  is  carried  out 
similar  to  that  performed  by  ILLCHAR,  and  the  program  printout  indicates  the  total 
number  of  input  records  read,  the  total  number  of  output  records  produced,  the 
total  number  of  input  hexidecimal  characters,  the  total  number  of  invalid  hex 
characters  and  the  hex  character  percent  error.  This  output  information  is  com¬ 
pared  to  the  output  of  ILLCHAR  to  determine  the  reliability  of  the  raw  data 
record  blocking  process.  The  flowchart  for  BLOCK  is  given  in  Figure  I. 7. A. 
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II.  OVERVIEW  OF  STRIPPING  AND  OUTPUT  PROGRAMS 


Figure  I I. A  is  an  overview  of  the  raw  tape  stripping  program .  Ten  data 
riles  are  involved  in  tne  program;  these  are  indicated  by  the  double  bordered 
lines  in  the  figure.  The  data  files  include  the  original  raw  data  file  des¬ 
cribed  above,  three  stripped  files  and  tneir  associated  directories,  the  C?A~'.'L 
date  file  (ERIK),  and  two  temporary  files  which  are  useful  in  co:."  tract  in."  tr 
other'  fiie:.  The  various  printer  outputs  which  car.  be  per, vs.'  :  :  r_r:  east  c; 
t;u.  :ij.es  are  shown  in  the  figure  using  parallel  a  era:.:.-. . 

The  names  of  the  procedures  required  for  initializing  the  :  ;  leu ,  utr:  • . 

an.  generating  the  outputs  are  snowr.  wit;.  t:i  „  i  re  •  ...net  .  tnt  ; ;  ur-.-.  , 

these  name.;  are  actual  1  prccedare  .  lut.  .  A  :  roceduro  til.  is  ...  set  o;  r.vst  •  ■ 

•control  commands  ne  cess-art  to  arta...  the  rest,  red  file-  v..i  execute  r  .-.res 
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pro.  ;rams  to  nor  form  tne  ’.'rocedure.  The  procedure  car.  the-.  .  e  .  .  if .  .-.te . 
single  cai,  statement  wnic;.  to- a..  f  .it  o 'htroi  cot".. . ,  t.;  ;  . 
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,\'n:i).iss  point  s  .  A!  so,  tin.-  tin.  >  ■  rresr  .  *nd  i  nr  t,  :  -.a 

or  ii.it  a  .-.’'il  t  ho  :  root  ior.  in  .ic  .•  rui-s  ( t  runcated  to  an  i:  - 
tcctr  )  art*  miciva.  i:  the  inst  rur.ent  i  s  not  r- - 1 .1 1  i  nr  .  r. 
entries  vi  i !  be  r.uuie  into  this  :  i  if. 

S  i'RiPPEI)  M'XMETER  Dl  RLE  i'OR'i  -  [his  contains  data  for  each  re>  rd  in  the 

st rinpeu  Luxraotor  File,  Entries  art-  record  nut: r or .  r..v  1 
nun-.ia  r.  :  irst  and  last  data  time  in  record,  ntiir.be r  >  :  cat 
tines,  and  date  recoru  was  .added  tc  rile. 

STRIPPED  Vi SLAB  FILE  -  This  file  contains  the  stripped  Variable  Path  Functie 
Meter  ( VI'F.V '  data  1  r.  c.  the  Kaw  .'.'ala  Flic-.  i  ike  tile  Strirr 
Luxneter  File,  trio  Vis  Lab  File  is  also  1  or  a  single  month 
period  containin'.;  up  to  it)  records .  one  :  or  a  sine.:*,  cat  . 
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ERIKFIEE  -  The  Erik  File  (OPAQUE  Data  Bank)  contains  values  taken  from  the 
three  stripped  files  described  above.  Each  file  is  for  a 
one  month  period  and  contains  31  records,  one  for  each  day. 

85  values  are  recorded  for  each  hour  using  the  format  given 
in  Appendix  I:  "ERIKFILE/OPAQUE  Data  Bank  Format".  Values 
entered  by  the  programs  reported  here  include  station  number, 
date  (year,  month,  day),  hour,  measurements  cycle  duration 
(1G  minutes)  and  instrument  data  from  the  stripped  arrays  for 
a  ten  minute  period  during  the  hour  (before  April  12,  1977, 

0923  CET  for  30  minutes  to  40  minutes  past  the  hour;  after 
that  date,  for  the  first  10  minutes  of  the  hour).  The  in¬ 
itialization  program  for  the  Erik  File  initializes  all  85 
words  for  each  hour;  additional  information  to  be  input  to  the 
file  from  other  sources  include  comment  numbers,  Meppen  weather 
data,  and  quality  integers  for  each  measurement. 

TEMPORARY  ERIKFILE  -  This  file  is  identical  to  the  Erik  File  described  above. 

It  is  useful  for  modifying  a  previously  created  Erik  File  if, 
say,  the  calibration  should  change  for  an  instrument. 

The  procedure  files  and  how  they  fit  in  the  overall  program  are  depicted  -n 
the  overview  Figure  II. A.  Except  for  the  initialization  programs,  each  has  been 
stored  as  a  permanent  file.  The  initialization  programs  were  not  stored  to  mini¬ 
mize  the  possibility  of  accidently  reinitializing  a  partially  created  data  file. 

A  brief  description  of  the  uses  of  each  procedure  file  follows: 

MINSTRIP  -  is  used  to  study  the  contents  of  the  Raw  Data  File  and  to  strip 
the  minute  channel  data  from  the  Raw  Data  File  to  construct  the 
Stripped  Minute  Channel  File  and  corresponding  Directory. 
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MINFIXUP  - 


MERGER 


FILESTAT  - 


li'xsta:  - 


VISSTRIP  - 


VISSTAT  - 


TP  LOTS 


XYPLOTS  - 


HISTOGRAM- 


SAPROFILE- 


M INDATA  - 


is  used  when  it  is  desirable  to  use  the  Temporary  Save  File  ir 
the  stripping  process. 

is  used  when  two  records  for  the  same  half-day  must  be  nortec 
into  one  record  as  is  required  when  raw  tapes  are  changed, 
is  used  to  print  out  a  summary  of  the  attached  Stripped  Minute 
Channel  File  and  to  print  out  the  contents  of  the  attached 
Stripped  Minute  Channel  Directory. 

is  used  to  strip  the  Luxmeter  data  from  the  Raw  Data  F a  1  to 
construct  the  Stripped  Luxmeter  File  and  corresponding  Directcrv. 
is  used  to  dump  portions  of  the  Stripped  Luxmeter  VL+e  arc  it.- 
id  rectory . 

is  used  to  strip  the  VPFM  data  from  the  Raw  Lata  Fi.U,  t>*  con¬ 
struct  the  Stripped  Vis lab  File  and  corresponding  Directory, 
is  used  to  dump  portions  of  the  Stripped  Vislab  File  anc  its 
Directory . 

is  used  to  generate  time  plots  from  the  Stric-ped  Minute  Channel 
File. 

is  used  to  generate  xy  plots  from  the  Stripped  Minute  Channel 
File . 

is  used  to  generate  one  month  histograms  from  the  Stripped  Minute- 
Channel  File. 

is  used  to  generate  profiles  of  data  contained  in  the  Stripped 
Minute  Channel  File. 

is  used  when  it  is  desired  to  print  scientific  (calibrated)  values 
from  up  to  7  specified  channels  over  a  specified  time  range  from,  the 


attached  Stripped  Minute  Channel  File. 


DAILYMAX  -  is  used  when  it  is  desired  to  print  out  the  maximum  count  (hourly 
maximums)  of  a  selected  channel  from  the  attached  Stripped  Minute 
Channel  File. 

ERIK  -  is  used  to  obtain  the  required  values  from  the  Stripped  Minute 
Channel  File  to  add  to  the  Erik  File,  to  print  out  a  summary  of 
the  status  of  the  Erik  File,  and  to  dump  the  contents  of  the 
Erik  File. 

LUXERIK  -  is  used  to  obtain  the  required  values  from  the  Stripped  Luxmeter 
File  to  add  to  the  Erik  File. 

VISERXK  -  is  used  to  obtain  the  required  values  from  the  Stripped  Vislab 
File  to  add  to  the  Erik  File. 

REPLACE  -  is  used  to  replace  all  or  a  portion  of  a  channel  of  the  attached 
Erik  File  with  the  corresponding  elements  of  the  attached  Tempo¬ 
rary  Erik  File. 

INIT  -  initializes  the  Stripped  Minute  Channel  File 

INITDR  -  initializes  the  Stripped  Minute  Channel  Directory 

INITTS  -  initializes  the  Temporary  Save  File 
INLXFL  -  initializes  the  Stripped  Luxmeter  File 

INLXDR  -  initializes  the  Stripped  Luxmeter  Directory 

INVSFL  -  initializes  the  Stripped  Vislab  File 

INVSDR  -  initializes  the  Stripped  Vislab  Directory 

INITOP  -  initializes  the  Erik  File 

Although  FORTRAN  has  library  subroutine  calls  which  can  add  records  to  an  exist¬ 
ing  disk  file  when  they  are  created,  it  has  been  found  to  be  much  safer  to  initialize 
the  total  file  before  it  is  filled  with  data.  This  is  the  purpose  of  the  8  initial¬ 


izing  programs  just  described. 


Examples  of  all  Che  outputs  which  can  be  obtained  from  the  data  files  des¬ 
cribed  above  and  which  are  shown  in  the  overview  are  presented  in  Figures  II. B 
to  II. P.  These  include: 
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FIGURE 
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FIGURE 
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FIGURE 
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FIGURE 

II. 0. 

FIGURE 

II. P. 

SURVEY  OF  RAW  DATA  FILE  SAMPLE  (MINSTRIP) 
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The  command  requests  printing  2000  characters  iol lowing  the 
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mal  digits)  Is  preceded  by  three  right  parent  hoses ;  channel 
data  (8  decimal  digits)  is  preceded  by  a  slash. 
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FIGURE  II.  f).  PROF  I  EE  OF  RAW  HAT  A  FIEF.  SAM  PEE  (MINSTRIP) 

The  commands  shown  request  listing,  nn  indication  ol  the  data  cent  ni  nod  in  the 
RAW  DATA  FI  Eli  lor  50  times  at  5  minute  intervals.  1  lie  integers  printed  are  an 
Indication  of  the  values  recorded.  iiiis  number  is  calculated  hv  takinr  the  in¬ 
teger  part  of  the  absolute  value  ol  the  count  divided  bv  L’OO.  A  net*. a  live  sicn 
indicates  the  counts  were  recorded  as  nor at  ice.  m  X  indii  ales  a  value  out  ol 
ranr.e,  and  an  asterisk  indicates  no  v.ilue  meant  . 
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FIGURE  II. G.  TIME  PLOT  SAMPLE  (TPLOTS) 

The  plot  shown  is  the  ILLUMINOMETER  Horizontal  channel  (Channel 
24),  Vertical  channel  (Channel  25),  and  Azimuth  (Channel  26)  data 
in  scientific  units  over  a  two  hour  period  around  nightfall. 
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FIGURE  II. It.  XV  I’ 1.0 1  SAMT1.F.  t XV r  1.01) 

The  plot  shown  is  a  scatter  diagram  over  a  10  hour  period  of  the  Eltro  vs  Barnes 
transmissometer  with  1-5  micron  filter.  The  scaling  values  have  been  super¬ 
imposed  on  the  plot. 
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FIGURE  II.J.  PROFILE  OF  STRIPPED  MINUTE  DATA  SAMPLE 

(SAPROFILE) 

The  profile  shown  gives  an  indication  of  the  data  contained 
in  the  STRIPPED  MINUTE  CHANNEL  FILE  for  a  two  hour  period  in 
March.  This  profile  has  the  same  form  as  that  mentioned  in 
Section  I.;  that  profile  however  Is  generated  from  the  RAW 
DATA  FILE. 
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FIGURE  II. L.  DAILY  MAXIMUM  VALUE  SAMPLE  (DAILYMAX) 

This  shows  the  maximum  count  reached  bv  the  Ll'XMLTER  instrument 
for  4  hours  around  noontime  on  8  consecutive  davs  in  March, 
1977.  This  data  is  useful  lor  checkin?'  lone-term  instrument 
d  r  lit. 
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FIGURE  II. M. 

STRIPPED  LUXMETER  DIRECTORY 

AND  DATA  DUMP  SAMPLE 

(LUXSTAT) 

The  printout 

shows  the  directory  and  partial  contents  for 

the  March,  1977,  STRIPPED 

LUXMETER  FILE. 

The  contents  dump  in 

- 

dicates  the 

time  (in  days 

,  hours,  minutes 

,  seconds) ,  the  time 

in 

terms  of  number  of  seconds  from  the  beginning  of  the  year,  the 
contents  of  horizontal  and  vertical  ILLUMINOMETER  channels,  and 
the  azimuth  in  degrees. 
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FIGURE  II. N.  STRIPPED  VISLAB  DIRECTORY  AND 
DATA  DUMP  SAMPLE  (VISSTAT) 


The  printout  shows  the  directory  and  partial  contents  for  the 
March,  1977,  STRIPPED  VISLAB  FILE.  For  each  time  are  the  .71 
data  values  discussed  in  Section  II. 3.1. 
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FTCl’RK  II. O.  ERIK  FI  LiC  CONTENTS  SUMMARY  SAMPLE  (ERIK) 

The  contents  of  the  partial  ERIKFILL  for  March  1  and  ,  1977  ,  is 
indicated.  The  status  of  data  for  each  of  the  entries  from  cle¬ 
ment  iO  to  element  89  is  represented  hv  an  X,  i>,  or  An  X  in¬ 
dicates  data  has  been  entered;  an  O  indicates  nothin;:  entered  vet; 
a  -  indicates  that  the  file  which  should  have  none rated  the  values 
has  been  processed  but  the  data  was  either  invalid  or  not  present . 
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I'  I  CURE  II. P.  FR1KFILE  HOURLY  DATA  DRIP  SAMTM.K  (FRTK) 

The  values  stored  in  the  partial  FR1KIILF  t  r  hour  0  of  March  I,  I S*  7  7 ,  are  shown. 

I  he  intrv  -9 . 00b  t  '■>')  indicates  that  the  file  which  should  have  generated  that  value 
has  been  processed,  but  the  data  was  either  invalid  or  not  present.  11. e  enlrv 
-1.  OOF.  MO  indicates  data  has  not  been  entered  Vet  .  i.  lenient  s  ,8  in  84  indicates 
the  data  qualitv  (initialized  to  9's),  and  85  is  a  spare  data  word. 


II. 1.  MINUTE  CHANNEL  STRIP  PROGRAM 


II. 1. 


II. 1. 


The  Minute  Channel  Strip  Program  (MINSTRIP)  is  used  to  study  the  con¬ 
tents  of  the  Raw  Data  File  and  to  strip  minute  channel  data  from  it  to  con¬ 
struct  the  Stripped  Minute  Channel  File  and  its  directory.  Items  discussed 
here  are  the  buffer  input  algorithms,  the  stripped  array  file,  and  directory 
structures,  and  the  Minute  Channel  Strip  Program  capabilities. 

1  BUFFER  INPUT  ROUTINES 

The  buffer  input  routines  are  routines  by  which  the  blocks  of  data  from 
the  Raw  Data  File  are  read  in  to  form  the  character  array  (KH)  from  which 
the  time  and  channel  data  is  stripped. 

There  are  two  different  algorithms;  one  for  initializing  the  character 
array  at  the  beginning  of  processing  or  when  a  command  is  issued  which 
requires  jumping  a  number  of  blocks,  and  one  for  continuously  moving  ahead 
during  the  stripping  process.  These  are  shown  in  Figures  II. 1. A  and  II.l.B. 

Initializing  the  character  array,  KH,  is  done  in  6  steps  as  diagrammed 
in  Figure  II. 1. A.  Notice  that  the  character  array  contains  a  complete  block 
of  data  plus  a  portion  of  the  next  block.  This  overlap  is  so  that  the 
character  array  can  continuously  yield  data  to  the  stripper.  The  raw  data 
blocks  are  read  into  an  intermediate  buffer  (BUFF)  using  the  FORTRAN  BUFFER 
IN  statement,  and  BUFF  is  then  decoded  to  form  the  character  array,  KH. 

The  technique  for  continuously  moving  ahead  during  normal  processing 
is  shown  in  Figure  II.l.B.  Here  also  6  steps  are  necessary  for  the  ad¬ 
vancement  . 

2  STRIPPED  MINUTE  CHANNEL  DATA  &  FILE  STRUCTURES 

The  stripped  minute  channel  data  is  stored  in  a  single  file  containing 
up  to  62  half-day  records.  Each  file  is  for  a  one  month  period.  Each  half¬ 
day  record  requires  12240  central  memory  words  and  thus  was  a  good  compromise 
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FIGURE  II.l.B.  ADVANCING  CHARACTER  ARRAY  ONE  BLOCK 


between  core  memory  storage  and  a  reasonable  time  length.  An  additional 
record  contains  the  half-day  information  for  each  of  the  62  half-day  records 
contained  in  the  file  and  is  used  primarily  for  checking. 


The  time  periods  for  the  half-day  records  has  been  chosen  according  to 
the  time  that  tapes  are  ordinarily  changed  at  the  Meppen  site;  hence,  the 
first  half-day  starts  at  10:00  and  ends  at  21:59;  the  second  half  of  the 
record  starts  at  22:00  and  ends  at  9:59  of  the  following  day.  For  example, 
the  record,  day  67,  half  1,  covers  the  period  67:10:00  to  67:21:59,  and  the 
record  day  67,  half  2,  covers  the  period  67:22:00  to  68:09:59. 

To  put  times  on  a  manageable  basis,  all  times  stored  and  used  in  the 
programs  are  in  terms  of  seconds  from  the  beginning  of  the  year.  This  con¬ 
version  is  handled  by  the  function  ITIME: 

ITIME(ID,IH,IM,IS)=60(60(24(ID)  +  IH)  +  IM)  +  IS 
A  similar  inverse  function  performs  the  conversion  back. 

The  data  stripped  from  a  single  minute  of  the  Raw  Data  File  requires  17 
words  of  the  12240  word  array  1DATA.  The  structure  of  these  17  words  is 
shown  in  Figure  II.l.C.  The  first  word  of  the  17  stores  the  time  of  the 
data;  the  remaining  16  words  contain  the  channel  data  packed  two  values  per 
word . 

The  location  of  the  data  in  the  IDATA  array  for  a  particular  minute  is 
determined  by  a  base  subscript  IBACE  (in  which  word  the  time  resides).  1BASE 
is  defined  as  follows: 

'I 

where  IT  ;■  t :*.•••  !  i’-'  t  i 
ai  d  I'i  ;r  : 

in  :  ‘  7  .  :•  I .  ....  ,  '  :  or  .  1 .  1 


I  RAT1'  =  Int 


v  17  + 


The  location  of  each  channel  data  in  terms  of  IBASE  is  shown  in 

“  i  r,  ir»  I T  .  1 .  '  . 

The  structure  of  a  sinrle  data  word  is  alsc  shown  in  Firure  II.l.C. 

Each  channel  data  is  stored  in  2h  bits  (6  -  4  bit  hex  characters).  How  the 
value  and  discrete  are  obtained  from  the  hex  characters  is  also  snown  in 
the  f  i  z'.ivr- . 

The  Stripped  Minute  Directory  contains  room  for  5  r- v*-  data.  Cur¬ 

rently  each  directory  is  used  for  only  1  month's  data.  Tor  each  record  is 
contained:  the  record  number,  the  tane  number ,  day.  half,  ana  toe  date 
«  -lav,  montn,  v-3..r:  tr.at  the  strinrec  lata  vac  entered .  ..r.  ei.-ntr.  or.tr" 

lor  eacn  record  is  a  sortie;;  ir.tuner.  This  is  updated  .:  acr.  tune  ...  recr.r: 
is  u  id.:.,  or  "odiii.ou.  Inis  array  or  sort  ins?  integer  .rive- a  in-  r  .  - 1:  • 
numb  era  in  chror.ol.irical  order  so  that  a  sorted  director".-  :r  sort-:-  i  cor.  • 
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FIGURE  II.l.C.  STRIPPED  MINUTE  CHANNEL  ARRAY  STRUCTURE 


II. 1.3  MINUTE  CHANNEL  STRIP  PROGRAM  CAPABILITIES 

The  Minute  Channel  Strip  Program  allows  the  user  to  inspect  the  con¬ 
tents  of  a  Raw  Data  File  or  strip  data  from  minute  channels.  With  the 
program  one  can: 

*  survey  all  or  a  large  portion  of  the  tape  file 

*  access  a  particular  data  time  or  block  on  the  tape  file 

*  study  a  small  segment  of  the  Raw  Data  File  contents  in  detail 
using  several  routines: 

i)  Dump  a  segment  of  the  Raw  Data  File, 

ii)  Show  the  next  several  data  times, 

iii)  Generate  a  summary  table  (profile)  of  a  segment  of  the  Raw 
Data  File  contents  (data  times,  which  channels  are  present, 
and  an  indication  of  their  values).  The  entries  in  the  sum¬ 
mary  table  can  be  one  of  the  following:  all  data,  everv  min¬ 
ute  only,  every  five  minutes  only,  every  30  minutes  only, 
every  hour  only,  or  everv  4  hours  onlv. 

*  strip  the  raw  data  from  minute  channels  to  create  a  Stripped  Min¬ 
ute  Channel  File  for  a  portion  or  for  all  of  a  half  day  record. 

*  automatically  strip  a  whole  tape 

*  merge  two  partial  records  of  the  same  half-day 

*  list  the  directory  of  half  day  records  already  stripped  in  the 
order  they  were  input  and  chronologically 

*  get  a  stripped  data  record  from  the  disk  file  and  load  it  into  core 

*  inspect  the  contents  of  the  stripped  data  record  residing  in  core. 


The  program  can  be  used  interactively  on  a  time-sharing  terminal.  The 
command  language  is  very  simple  to  use  so  that  the  experimenter  may  desire 


to  use  tne  program  himself.  The  command  language  is  also  flexible;  one  mav 
use  statements  which  are  verv  readable  or  use  short  abbreviations  ror  con¬ 
venience.  The  program  can  also  oe  executec  in  batch  mode  so  that  results 
may  De  output  on  tne  line  printer. 

To  use  the  program  one  must  first  attach  it,  the  aesirec  haw  jata  :^_e, 
ana  the  Stripped  Minute  Channel  File  and  .  irertorv  resicun?  or.  the  dish. 
First  there  is  a  short  log-in  procedure  ix.  whi.cn  tne  use  sj-ecit  ies  tne  cur¬ 
rent  date  ana  is  requested  to  unrut  tne  strirpea  race  naroer  and  tne  term 
or  coding  on  the  naw  bate  !  tie  vet  tt.er  hex  or  character  - . 


( 


LI. 2  LUXMETER  STRIP  PROGRAM 


The  Stripped  Luxmeter  File  and  Directory  structure  and  Luxmeter  Strip  Program 
capabilities  are  presented  below. 

I  I. 2.1.  STRIPPED  LUXMETER  FILE  AND  DIRECTORY  STRUCTURE 

Data  for  the  stripped  Luxmeter  is  stored  in  files  which  hold  one  month's 
data.  Each  record  in  the  file  is  intended  to  hold  the  stripped  data  from  1 
Raw  Data  File. 

The  Luxmeter  instrument  (which  measures  the-  horizontally  and  vertically  in¬ 
cident  illumination)  is  continuously  rotating  in  a  clockwise  direction  viewed  from 
above,  and  the  data  to  be  entered  into  the  Stripped  Luxmeter  File  is  that  when  the 
vertical  axis  is  in  the  direction  of  the  compass  points.  The  average  rotation  rate 
is  12  minutes  per  revolution  of  30°  per  minute.  The  instrument  sample  time  is  4 
seconds  so  that  the  instrument  rotates  through  2°  between  each  sample.  The  algorithm 

used  in  selecting  the  samples  is  as  follows:  the  first  sample  between  0cr:2c.  90r~2  , 

and  180°42°,  and  270°42  is  taken  as  the  north,  east,  south,  and  west  sample 
respective  1 y . 

To  determine  the  required  size  of  the  Stripped  Luxmeter  File,  we  note  that 
at  12  minutes  per  revolution  we  should  obtain  1  sample  for  the  file  every  3 
minutes.  Assuming  a  raw  data  tape  mav  be  up  to  4  davs  lone,  we  need  to  store  at 

least  60/3  x  24  x  4  =  1920  samples  per  file.  For  each  sample  we  sti  re  four 

v;i  1  ucx : 

!.  The  data  r  imo  (in  seconds  from  the  heinninr  ot  tin  war  * 

2.  The  horizontal  channel  lata  i  ch  nn-  I  24  >  Tor;;:  i  men.,,,-...-  .  „•  ,, 

i  in.  t  t  ■.  i  :  c  Isamu  1  a. -la  (  eh. nine  1  2:  ,  <  t  <  *1  N  1  *  t  *  *•  •  *  1 


Consequently  we  use  an  array  dimensioned  4  x  2000  in  the  program.  If  the 
raw  data  for  a  particular  sample  was  an  overflow,  9999  is  stored  as  the  value 
for  channel  24  or  25.  If  the  raw  data  was  not  all  integer  digits  or  the  leading 
bit  was  not  zero,  8888  is  stored  as  the  value  for  channel  24  or  25. 

For  each  record  entered  into  the  Stripped  Luxmeter  File,  the  following  en¬ 
tries  are  made  in  the  Directory: 

(1)  Record  It  (1  to  10) 

(2)  Raw  Tape  it 

(3)  First  data  time  in  record 

(4)  Last  data  time  in  record 

(5)  Number  of  data  times  contained  in  record 

(6) ,  (7),  (8)  Date  record  was  entered  in  file  (day,  month,  year) 

Since  there  may  be  up  to  10  records  per  file,  the  directory  information  array 
is  dimensioned  8  x  10.  Several  months  required  more  than  10  data  tapes;  two  Lux- 
meter  Files  were  generated  for  those  months. 

II. 2. 2 _  LUXMETER  STRIP  PROGRAM  CAPABILITIES 

With  the  Luxmeter  Strip  Program  the  user  can  do  the  following: 

*  strip  all  or  a  portion  of  the  attached  Raw  Data  File  using  a  time 
efficient  algorithm  (strip)  or  a  slightly  less  efficient  algorithm 
(claw),  which  is  more  impervious  to  bad  raw  tape  data,  and  load  it 
into  the  Stripped  Luxmeter  File 

*  list  the  directory  or  records  in  the  Stripped  Luxmeter  File 

*  get  a  stripped  data  record  from  the  attached  Stripped  Luxmeter  File 

*  dump  any  portion  of  the  record  in  core 

Tr  use  the  program,  one  must  use  a  procedure  call  as  described  above.  There 
is  a  short  log-in  procedure  (identical  to  that  in  the  Minute  Channel  Stripping 
Program).  The  strip  commands  may  then  be  used. 


II. 3  VISLAB  STRIP  PROGRAM 


The  Vislab  Strip  Program  strips  data  from  the  Variable  Path  Function  Meter 
(VPFM) .  The  Stripped  Vislab  File  structure  is  presented  below.  The  Directory 
structure  is  identical,  and  the  user's  instructions  are  nearly  the  same  as  the 
Luxmeter  Strip  Program;  only  differences  will  be  mentioned  below. 

II. 3.1  STRIPPED  VISLAB  FILE  STRUCTURE 

Like  the  Stripped  Luxmeter  File,  each  record  holds  the  stripped  data  from 
1  raw  data  tape,  and  10  records  comprise  a  one-month  file. 

The  VPFM  instrument,  unlike  the  Luxmeter,  does  not  rotate  at  constant 
rate  but  rather  positions  itself  and  dwells  at  a  compass  point  for  a  short  in¬ 
terval  of  time.  The  algorithm  used  is  to  select  all  points  which  are  within 
±  2  degrees  of  the  compass  points  and  process  them.  For  some  periods  of  time 
the  instrument  was  not  rotating,  and  for  this  the  algorithm  accepts  all  points 
and  assumes  the  instrument  is  east  directed. 

Data  is  normally  recorded  onto  the  raw  Lape  once  per  second  during  a  10 
minute  period  each  hour.  The  stripping  technique  stores  data  meeting  the 
direction  criteria  above  for  this  10  minute  period  and  then  is  processed  to 
obtain  first,  last,  max,  and  min  values  for  storing  in  the  stripped  array. 

Values  outside  the  physical  range  of  the  readings  are  not  used.  Also  the 
filter,  which  is  assumed  not  to  change  over  a  ten-minute  period  is  also  inserted 
into  the  array. 

For  each  10  minute  period  the  stripped  file  contains  the  following  values: 


1.  Time  (in  seconds  after  the  beginning  of  the  year)  of  the  first 
data  point 


2  _ 
3. 


First  value 
Last  value 


} 


for  north  direction  (0°  +  2°) 


75. 


4. 


Max  value 


for  north  direction  (0°  ±  2°) 


5.  Min  value 

6.  Number  of  samples  used 

7-11.  Same  as  2-6  but  for  east  direction  (90°  ±  2°) 

12-16.  Same  as  2-6  but  for  south  direction  (180°  ±  2°) 

17-21.  Same  as  2-6  but  for  west  direction  (270°  ±  2°) 

22.  Filter  used 

Assuming  that  a  raw  data  tape  may  be  up  to  5  days  long  (this  was  determined 
to  be  a  better  figure  than  the  4  day  period  used  for  the  Luxmeter  File),  we  must 
store  the  22  elements  a  total  of  5  x  24  =  120  times.  Hence,  the  stripped  data 
array  is  dimensioned  22  x  120  in  the  program. 

The  directory  structure  is  identical  to  that  used  for  the  Luxmeter  File. 


1 
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11*4.  MINUTE  CHANNEL  OUTPUTS 

Routines  Rave  been  written  to  obtain  graphical  outputs  and  tables  from 
the  Stripped  Minute  Channel  Files.  Typical  samples  are  shown  in  Section  II. 

One  can  obtain: 

1.  time  plots  over  any  time  scale  (up  to  one  month)  (See  Figure  11. G.) 

2.  xy  plots  (up  to  one  month)  (See  Figure  II. H.) 

3.  histograms  (up  to  one  month)  (See  Figure  II. I.) 

4.  two-hour  stripped  array  profiles  (See  Figure  II. J.) 

5.  data  tables  for  up  to  7  channels  over  specified  period  of  time 
(See  Figure  II. K.) 

6.  daily  maximum  counts  (See  Figure  II. L.) 

Ail  of  the  plot  routines  use  a  "plot  composition  algorithm".  An  array, 
which  will  be  the  plot,  is  first  cleared  and  a  grid  is  applied.  Next,  each 
function  is  applied  bv  inserting  characters  at  appropriate  locations  in  the 
array.  Finally,  the  composed  array  is  printed  out. 

The  configuration  of  axes  used  on  the  plot  routines  is  shown  in 
Figure  II. 4. A.  The  grid  is  determined  by  4  numbers: 

number  of  divisions  in  vertical  direction  (ndiv^) 
number  of  points  per  division  in  vertical  direction  (npdv) 
number  of  divisions  in  horizontal  direction  (ndiv^) 
number  of  points  per  division  in  horizontal  direction  (npd^) 

For  the  grid  shown,  these  numbers  are  8, 5, 5,10  respectively.  The  only 
restrictions  on  the  grid  size  is: 

ndiv  *  npd  <  00 
v  v  — 


ndiv,  *  npd,  <  120 

h  n  — 


ndiv 

v 

(8  slu'vn  I 


For  time  plots  it  is  necessary  to  specify  the  number  of  minutes  per  division 


in  the  horizontal  direction.  This  should  be  selected  so  that  each  space  is  at  least 
one  minute. 

There  are  three  options  for  scaling  the  variables  to  be  placed  in  the  grids. 


Option  0  -  automatic  linear  scaling.  The  bottom  and  top  magnitudes 
are  selected  with  an  automatic  scaling  routine. 

Option  1  -  linear  scaling.  The  values  of  the  function  at  the  bottom 
and  top  of  the  graph  are  specified  by  the  user. 

Option  2  -  logarithmic  scaling.  The  decipowers  at  the  bottom  and  top 
of  the  graph  are . specif ied  by  the  user.  (decipower  is  the 
exponent  i  in  10  ) 

Every  channel  to  be  plotted  can  be  scaled  separately.  If  no  scaling  is 
specified,  Option  0  is  used  as  default. 

To  make  the  plots  as  clear  as  possible,  unique  characters  have  been  as¬ 
signed  to  each  possible  function.  Different  filters  for  the  BARNES  instrument 
have  different  plot  characters.  These  have  been  applied  consistently  whether 
the  plot  is  a  time  plot  or  histogram.  For  example,  the  MRI  Channel  2  data  will 
always  be  plotted  using  the  character  B.  A  list  of  current  channel  numbers 


and  the  corresponding  plot  symbols  used  are  given  in  Figure  II. A. B. 


LIST  OF  CHANNEL  NUMBERS 


CHANNEL  NUMBER  PLOT  SYMBOL 


0  A 

1  B 

2  C 

3  D 

4  E 

5  F 

6  C 

7  H 

11  J 

12  K 

13  L 

14  M 

15  N 

16  0 

17  P 

21  q 

210  6 

211  7 

212  8 

213  9 

2 '3  R 

24  S 

25  T 

26  U 

31  V 

32  v: 

33  X 

34  Y 

36  7. 

37  * 


DESCRIPTION 

MR I  NEPHELOMETER  Channel  1 

MRI  NEPHELOMETER  Channel  2 

MR I  NEPHELOMETER  Channel  3 

MRI  NEPHELOMETER  Channel  4 

ELTRO  TRANSMISSOMETER  Output 

NIGHT  PATH  Filter 

NIGHT  PATH  Output  Signal 

NIGHT  PATH  Range 

VPFM  Photo  Meter 

VPFM  Azimuth 

VPFM  Filter  Position 

LASER  PAR 

LASER  Power  Meter 

LASER  Power  Meter 

LASER  Gain 


BARNES  IR  TRANSMISSOMETER  (without  regard  for  lilter) 
BARNES  IR  TRANSMISSOMETER  with  filter  0 
BARNES  IR  TRANSMISSOMETER  with  lilter  ! 

BARNES  IR  TRANSMISSOMETER  with  filter  2 
BARNES  IR  TRANSMISSOMETER  with  lilter  3 
RAIN  GAUGE 


1 LLUMT NOMETE R  Horizontal 

TLLUM I NOMETER  Vert i ea 1 

I LLUMT NOMETER  Azimuth 

SCANNING  NEI’II [.  Angle 

SCANNING  NEPHl.  Seale  Shi  It 

SCANNING  NEPHl.  Photo  pitu le 

SCANNING  N1.PH1.  Monitor 

KPPI.EY  PYROHEL IOMETER  Filtered  Channel 

Ei’Pl.EY  PYROHEL  IOMETER  Direel  Channel 


Figure  II. 4f!  Channel  Numbers 
and  Plot  Svmhols 


II. 5  GENERATING  OPAQUE  DATA  FILE  (ERIKFILE) 


The  Erik  file  is  a  monthly  file  containing  values  generated  from  the  three 
stripped  files,  the  Stripped  Minute  Channel  File,  Luxmeter  File,  and  Vislab  File. 
Three  separate  procedure  files,  ERIK,  LUXERIK,  and  VISERIK  are  used  to  obtain 
values  for  the  Erik  file  from  each  of  the  three  stripped  files.  ERIK  also  con¬ 
tains  several  routines  to  output  information  from  the  Erik  file. 

I I. 5.1.  ERIKFILE  STRUCTURE 

The  Erik  file  is  a  one-month  file  containing  31  records,  one  for  each  day 
of  the  month.  For  months  containing  less  than  31  days,  31  records  are  still 
used  for  simplicity;  the  extra  records  are  merely  neglected.  Each  daily  record 
contains  an  array  dimensioned  85  X  24.  There  are  85  entries  for  each  hour  of 
the  day.  There  is  one  entry  for  each  of  the  78  data  words  in  the  standard 

hourly  OPAQUE  data  set  (see  Fenn1),  and  one  entry  for  each  of  the  7  different 

types  of  optical  measurements,  which  indicate  the  reliability  of  the  data. 

The  entries  are  derived  from  a  10-minute  period  following  the  hour,  Mean  l.ocal 
Solar  Time.  For  tapes  before  April  12,  1977,  this  10-minute  period  was  between 
30  and  40  minutes  past  the  hour  on  the  data  logger  clock  (consistent  with  the 
local  time  zone).  After  that  date  the  data  logger  clock  was  adjusted  to  Mean 
Lo  ll  Solar  Time,  so  this  10-minute  period  was  the  first  10  minutes  of  the 
hour.  The  first  program  was  written  for  this  latter  case  but  corrected  to  ac¬ 
cept  times  between  30  and  40  minutes  past  the  hour.  The  program  must  be  read¬ 

justed  for  processing  data  collected  after  Apri]  12,  1977. 

The  85  entries  collected  each  hour  consist  of  several  different  kinds 
defined  in  the  document  "Meppen  Measurements  Input  Into  OPAQUE  Data  Hank”, 
which  is  reproduced  in  Appendix  I.  The  85  words  for  each  hour  was  initialized 
as  full ows : 

cnn ,  R.  K.  (1978)  OPAQUE ,  Vo  I  1, 

FGI. -TK-7K-00I  1  ,31. 


1. 


(station  number)  71 


2.  (date)  year,  month,  day,  packed  into  6  rightmost  digits 

3.  (time)  hour  (0,1,2 . 23) 

4.  (duration  of  measurement  cycle)  10 

5-10  (comments  and  scattering-filter-humidity)  0 

+30 

11-57  (measurement  values)  -1  x  10 

+  30 

58-77  (weather  data)  -1  x  10 

78-85  (data  quality)  appropriate  number  of  9's 

The  processing  of  measurement  values  are  of  several  types: 

1.  The  MRI  Photopic  channel,  Eltro,  Horizontal  Luxmeter,  Night  Path  Luminance, 
and  the  east  direction  VPFM  required  the  beginning  value,  end  value, 

max  value,  min  value,  and  number  of  samples  used  in  the  10  minute  period. 

2.  The  vertical  Luxmeter  required  one  value  from  each  of  the  four  compass 
points . 

3.  The  VPFM  samples  in  the  south,  west,  and  north  compass  points  were 
required  in  addition  to  the  5  values  above  for  the  east  direction. 

4.  The  direct  Eppley  required  the  beginning  and  end  value. 

5.  The  filtered  Eppley  and  Barnes  instrument  required  values  entered, 
depending  on  the  filter  being  used  for  the  measurement. 

If  the  values  were  supposed  to  be  added  to  the  array  but  were  not  either 

because  the  values  were  not  physically  present,  or  i t  was  not  possible  to  interpret 

30  90 

the  data,  then  the  -1  x  10  was  changed  to  -9  x  10  so  that  it  is  possible  to 
distinguish  between  these  two  cases. 

1_I_._5_._2._  F.R_TK  PROGRAM  CAPABILITIES 

The  ERTK  Program  al  lows  the  user  to  process  data  from  the  Stripped  Minute 
Channel  File  into  the  format  necessary  for  the  Erik  File  over  a  time  period 
specified  by  a  begin  and  end  time.  It  also  allows  the  user  to  output  the  con¬ 
tents  of  the  Erik  File  in  several  forms: 

,H2. 


1. 


contents  summary  of  a  given  record 


2.  contents  summary  of  all  31  records  in  the  file 

3.  dump  of  all  values  of  a  given  day  between  specified  hours 

4.  dump  of  all  values  starting  and  finishing  at  specified  days 

5.  display  of  specified  channels  only  between  specified  days 

Finally  it  allows  the  user  to  replace  one  particular  channel  of  the 
attached  Erik  File  with  the  corresponding  channel  of  the  attached  Temporary 
Erik  File  over  a  specified  time  range. 
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Conclusions 


The  similarity  of  many  of  the  programs  described  in  Part  I  and  Part  II  is 
due  to  the  sequential  nature  of  the  data  recording  format  and  the  need  for  a 
"quick-edit"  approach  to  complement  the  stripping  and  formatting  of  the  data 
base  for  subsequent  access.  The  volume  of  data  being  processed  requires  that 
pre-editing  of  the  data  is  a  necessary  prerequisite  to  stripping  and  formatting 
for  it  provides  information  on  the  data  tape  recording  quality  along  with  data 
parameters  that  serve  as  processing  checks  and  verification.  In  attempting  data 
recovery  on  especially  "noisy"  recordings,  an  independent  means  of  verification 
is  mandatory. 

The  programs  described  in  this  report  constitute  a  complete  system  package 
to  be  used  in  the  accessing,  processing,  reduction,  and  analysis  of  the  OPAQUE 
data  base  generated  at  the  U.S.A.F.  field  station  in  Meppen,  Fed.  Rep.  of  Germany. 
While  some  of  the  programs  are  unique  to  this  application;  i.e.,  the  instrument 
calibration  package  and  the  specific  data  file  packing  algorithm,  most  of  the 
programs  can  be  readily  adapted  to  other  applications.  All  of  the  raw  data  tape 
utility,  editing,  processing,  and  display  programs  can  be  readily  reconfigured 
to  operate  with  different  tape  recording  formats.  The  general  format  of  the 
data  files  can  be  used  in  the  processing  of  data  from  other  sources,  and  the 
modularity  of  the  structure  allows  numerable  variations  in  the  sequence  of  pro¬ 
cessing  steps.  Additional  algorithmic  modules  can  be  linked  into  the  program 
packages  with  the  appropriate  user-defined  commands. 

The  use  of  procedure  files  to  call  and  execute  the  system  programs  greatly 
simplifies  the  user-system  interface.  From  the  user  standpoint,  the  elimination 
of  a  large  number  of  control  cards  from  the  JOB  run  deck  allows  one  to  concen¬ 
trate  on  the  interpretation  and  analysis  of  the  computer  printout  rather  than 
correct  control  card  errors. 
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Appendix  I 


ERIKFILE /OPAQUE  DATA  BANK  FORMAT 

Data  Bank 

Data  Logger 

W  ord  N  o . 

Data  Item 

Measurement  Channel 

1 

Station  No. 

=  71 

2 

Date  -  Year,  Month,  Day 

3 

Time 

4 

Duration  of  Measurement  Cycle 

=  10 

5 

Comment  Numbers 

=  000 

6 

II  II 

=  000 

7 

II  II 

=  000 

8 

M  ft 

=  000 

9 

11  II 

=  000 

10 

Scattering  xlOO  +  Filter  x  10  +  Humidity 

11 

S  BEG 
s 

12 

S  FIN 
s 

13 

S  MAX 
s 

MRI  Nephelometer  2 

14 

S  MIN 

(After  Mar  78 

s 

AEG  Point  Visibility  Meter) 

15 

N 

V 

=  Number  of  Measure¬ 
ments 

16 

E  BEG 

g 

17 

e'  fin 

g 

18 

E  max 

R 

Eltro  Transmissometer  4-0 

19 

E  MIN 

R 

20 

Nv 

21 

h  BEG 

22 

E  FIN 

23 

E  MAX 

Horizontal  24 

Luxmeter 

24 

E  MIN 

25 

26 

E  (North) 

V 

27 

EE  (East) 

V 

28 

F,B  (South) 

Vertical  25 

V 

Luxmeter  (compass 

29 

EW  (West) 

points  from 

>/.  'i 

Data  Bank 
Word  No. 


Data  Item 


Measurement 


Data  Logger 
Channel 


30 

NT 

L  BEG 

P 

31 

NT 

L  FIN 

P 

32 

NT 

L  MAX 

Night  Path 

P 

Luminance 

33 

NT 

L  MIN 

P 

34 

NV 

35 

fe  BEG 

P 

36 

fe  FIN 

P 

37 

fe  MAX 

Vis  Lab. 

P 

Variable  Path 

38 

fe  MIN 

P 

Function  Meter 

39 

NV 

40 

FS 

P 

41 

FW 

P 

42 

fn 

P 

43 

E  1 
o 

■  =  0.945 

44 

E  “ 
o 

•  =  0.4 

45 

E  3 

0 

■  =  0.87  Eppley 

Filtered 

46 

E4 

0 

\  =1.06 

47 

Eo5 

3  =  0.75 

48 

E  6 
o 

'  =  0.55 

49 

Eo? 

photopic 

50 

E  8 

o 

>  =  0.3  to  3.5 

51 

E  9 

Direct 

o 

Eppley 

52 

E  10 

o 

3  =  0.3  to  3.5 

86. 


6 

(with  5  &  7 


11 

(Directions 
from  12) 


37  f  =  i 

37  !  =  . 
3  7  f  =  ' 

37  I  =  - 
3  7  t  =  3 

3  7  f  =  6 
37  f  =  7 
36  BEG 

36  FIN 


Data  Bank 
Word  No. 


Data  Item 


Measurement 


Data  Logger 
Channel _ 

Before  Days  After 


53 

T1 

3-5u  EEC 

Day 

96 

96-145 

145 

I 

f  = 

0 

- 

f  = 

T 

54 

T2 

8-12u 

f  = 

3 

f  =  3 

f  = 

3 

Barnes 

55 

T3 

8-13 

Transmissometer 

f  = 

2 

f  =  2 

f  = 

2 

56 

T 

X 

Open  or  4u 

f  = 

1 

f  =  0 

f  = 

0 

57 

T 

8 

3—5 u  FIN 

f  = 

0 

- 

f  = 

1 

58 

u 

D~ 

T 

Contel 

59  A 

60  B 

61  C 

62  D 

63  E 

64  F 

65  C. 

66  H 

67  I 


68 

N 

Cloud  Cover 

69 

dd 

Wind  Direction  at  10m 

70 

ff 

Wind  Speed  at  10m 

71 

d2d2 

Wind  Direction  at  2m 

72 

f2f2 

Wind  Speed  at  2m 

73 

PPP 

Pressure 

74 

TTT 

Temperature 

75 

T  T  T 
ddd 

Dew  Point  Temp 

76 

rrr 

Rain  Rate 

77 

E 

General  Ground  State 

78 

QQQQ 

Packed  MRI  Data  Quality 

79 

QQQQ 

Packed  Eltro  Data  Quality 

80 

QQQQQQQQ 

Packed  Luxmeter  Data  Quality 

81 

QQQQ 

Packed  Night  Path  Data  Quality 

82 

QQQQQQQ 

Packed  Vis  Lab  Data  Quality 

83 

QQQQQQQQQQ 

Packed  Eppley  Data  Quality 

84 

QQQQQ 

Packed  Barnes  Data  Quality 

85 

RRR 

Total  Rain  for  Past  Hour 

A  7 . 


Channel 

21 


